Visual Sign Language Recognition
نویسندگان
چکیده
We have developed the Hand Motion Understanding (HMU) system that understands static and dynamic signs of the Australian Sign Language (Auslan). The HMU system uses a visual 3D hand tracker for motion sensing, and an adaptive fuzzy expert system for classification of the signs. This paper presents the hand tracker that extracts 3D hand configuration data with 21 degrees-of-freedom (DOFs) from a motion sequence that is captured from a single viewpoint, with the aid of a colour-coded glove. The tracker is used for the training and evaluation of the HMU system with 22 static and dynamic signs. Before training the HMU system recognised 20 signs, and after training, it recognised 21 signs.
منابع مشابه
توانش های شناخت، نظریه ذهن و حافظه دیداری در کودکان کم شنوا
Hearing problems in children hard of hearing, in addition to communication skills, will effect social interaction too. One aspect of social recognition which has attracted an increasing attention in recent years is the development of children's intelligence theory. In connection with intellectual and recognition abilities in children hard of hearing, intelligence is a subject that has always be...
متن کاملVisual Recognition of American Sign Language Using Hidden Markov Models
Hidden Markov models (HMM's) have been used prominently and successfully in speech recognition and, more recently, in handwriting recognition. Consequently , they seem ideal for visual recognition of complex, structured hand gestures such as are found in sign language. We describe an HMM-based system for recognizing sentence level American Sign Language (ASL) which attains a word accuracy of 99...
متن کاملVisual Modeling and Feature Adaptation in Sign Language Recognition
We propose a tracking adaptation to recover from early tracking errors in sign language recognition by optimizing the obtained tracking paths w.r.t. the hypothesized word sequences of an automatic sign language recognition system. Hand or head tracking is usually only optimized according to a tracking criterion. As a consequence, methods which depend on accurate detection and tracking of body p...
متن کاملApplying mean shift and motion detection approaches to hand tracking in sign language
Hand gesture recognition is very important to communicate in sign language. In this paper, an effective object tracking and hand gesture recognition method is proposed. This method is combination of two well-known approaches, the mean shift and the motion detection algorithm. The mean shift algorithm can track objects based on the color, then when hand passes the face occlusion happens. Several...
متن کاملReal-Time American Sign Language Recognition from Video Using Hidden Markov Models
Hidden Markov models (HMM’s) have been used prominently and successfully in speech recognition and, more recently, in handwriting recognition. Consequently, they seem ideal f o r visual recognition of complex, structured hand gestures such as are found in sign language. We describe a real-time HMM-based system for recognizing sentence level American Sign Language (ASL) which attains a word accu...
متن کاملSign Language Recognition with the Kinect Sensor Based on Conditional Random Fields
Sign language is a visual language used by deaf people. One difficulty of sign language recognition is that sign instances of vary in both motion and shape in three-dimensional (3D) space. In this research, we use 3D depth information from hand motions, generated from Microsoft's Kinect sensor and apply a hierarchical conditional random field (CRF) that recognizes hand signs from the hand motio...
متن کامل